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DESCRIPTION 



Contents Synthesizing Apparatus, Contents Synthesizing Method, 
Contents Synthesizing Program, Computer Readable Recording Medium 
Recording Contents Synthesizing Program, Data Structure of Contents Data, and 
Computer Readable Recording Medium Recording Contents Data 

Technical Field 

The present invention relates to contents synthesizing apparatus, contents 
synthesizing method, contents synthesizing program, computer readable recording 
medium recording contents synthesizing program, data structure of contents data, and 
computer readable recording medium recording contents data. More specifically, the 
present invention relates to contents synthesizing apparatus, contents synthesizing 
method, contents synthesizing program, computer readable recording medium recording 
contents synthesizing program, data structure of contents data, and computer readable 
recording medium recording contents data that are suitable for synthesizing contents 
data. 

Background Art 

Recently, along with the wide spread use of the Internet, sales and distribution of 
digitized contents such as images and motion pictures are much increasing. When such 
digital contents are to be formed from scratch, in most cases, a dedicated authoring tool 
is used. Use of a dedicated authoring tool, however, often requires high skill, and 
therefore, it is not easily handled by a general user. In order to solve such a problem, a 
method has been known in which figures, objects and backgrounds for the contents are 
saved beforehand as components, and the components are combined to form new 
contents. 

In the foregoing, conventional art related to the present invention has been 



described based on general technical information known to the applicant. To the best 
of applicant's memory, the applicant does not have any information to be disclosed as 
prior art, before the filing of this application. 

The conventional method of synthesizing contents data, however, has the 
5 following problems. First, it is impossible for a creator of the contents data to define 
the synthesizing process. By way of example, a setting that allows combination of 
certain contents with specific contents only is not possible. Therefore, a creator of the 
contents cannot define the manner of synthesis. 

Second, when the contents data are synthesized, a synthesizing script is 
10 necessary. It is difficult, however, for a general user to prepare the synthesizing script. 
Therefore, a general user must search for a synthesizing script matching the contents 
data to be synthesized. 

Disclosure of the Invention 

15 An object of the present invention is to provide contents synthesizing apparatus, 

contents synthesizing method, contents synthesizing program, computer readable 
recording medium recording contents synthesizing program, data structure of contents 
data, and computer readable recording medium recording contents data that allow 
control of the synthesizing process from the side of the contents data. 

20 Another object of the present invention is to provide contents synthesizing 

apparatus, contents synthesizing method, contents synthesizing program, computer 
readable recording medium recording contents synthesizing program, data structure of 
contents data, and computer readable recording medium recording contents data that do 
not require preparation of new synthesizing script that is necessary for synthesizing the 

25 contents data. 

In order to attain the above described objects, according to one aspect, the 
present invention provides a contents synthesizing apparatus, including: an input 
receiving portion receiving an input of first contents data including a synthesizing script 
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describing synthesis of contents data and an input of second contents data; and a 
synthesis processing portion synthesizing the input first contents data with the input 
second contents data, based on the synthesizing script included in the input first contents 
data. 

According to the present invention, the contents synthesizing apparatus receives 
inputs of the first contents data including a synthesizing script describing synthesis of 
contents data and the second contents data, and based on the synthesizing script 
included in the input first contents data, the input first contents data is synthesized with 
the input second contents data. Therefore, the synthesizing process is controlled by the 
synthesizing script included in the first contents data. Further, as the synthesizing 
script is included in the first contents data, it is unnecessary to newly prepare the 
synthesizing script when the first contents data is to be synthesized with the second 
contents data. As a result, a contents synthesizing apparatus can be provided that 
enables control of the synthesizing process from the side of the contents data and 
eliminates the necessity of newly preparing the synthesizing script required for 
synthesizing contents data. 

Preferably, the apparatus further includes an attribute determining portion 
determining an attribute of the second contents data; wherein the synthesizing script 
includes scripts corresponding to a plurality of attributes of the contents data 
respectively; and the synthesis processing portion synthesizes the input first contents 
data with the input second contents data, based on the script corresponding to the 
determined attribute. 

According to the present invention, the attribute of the second contents data is 
determined by the contents synthesizing apparatus, and based on the script 
corresponding to the determined attribute included in the synthesizing script included in 
the first contents data, the first contents data is synthesized with the second contents 
data. Therefore, the synthesizing process is controlled by the script corresponding to 
the attribute of the second contents data. As a result, the synthesizing process can be 



controlled from the side of the contents data, and the synthesizing process appropriate 

for the attribute of contents data becomes possible. 

Preferably, the apparatus further includes a time obtaining portion for obtaining 

current time; wherein the synthesizing script includes scripts corresponding to time of 
5 synthesis by the synthesis processing portion; and the synthesis processing portion 

synthesizes the input first contents data with the input second contents data, based on 

the script corresponding to the obtained current time. 

According to the present invention, the contents synthesizing apparatus obtains 

the current time, and based on the script corresponding to the obtained current time 
10 included in the synthesizing script of the first contents data, the first contents data is 

synthesized with the second contents data. Therefore, the synthesizing process is 

controlled by the script corresponding to the time of synthesis. As a result, the 

synthesizing process can be controlled from the side of the contents data, and the 

synthesizing process appropriate for the time of synthesizing the contents data becomes 
15 possible. 

Preferably, the apparatus further includes a position obtaining portion obtaining a 
current position of the contents synthesizing apparatus; wherein the synthesizing script 
includes scripts corresponding to positions; and the synthesis processing portion 
synthesizes the input first contents data with the input second contents data, based on 

20 the script corresponding to the obtained current position. 

According to the present invention, the contents synthesizing apparatus obtains 
the current position of the contents synthesizing apparatus, and based on the script 
corresponding to the obtained current position included in the synthesizing script of the 
first contents data, the first contents data is synthesized with the second contents data. 

25 Therefore, the synthesizing process is controlled by the script corresponding to the place 
of synthesis. As a result, the synthesizing process can be controlled from the side of 
the contents data, and the synthesizing process appropriate for the place of synthesizing 
the contents data becomes possible. 
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Preferably, the synthesizing script includes another synthesizing script; and the 
apparatus further includes a portion adding said another synthesizing script to the 
synthesized contents data. 

According to the present invention, the contents synthesizing apparatus adds 
another synthesizing script included in the synthesizing script to the synthesized contents 
data. Therefore, the synthesizing process can be controlled from the side of the newly 
synthesized data. 

Preferably, the synthesizing script includes location information indicating 
location of another synthesizing script; and the apparatus further includes: an obtaining 
portion obtaining another synthesizing script indicated by the location information; and 
an adding portion adding the obtained another synthesizing script to the synthesized 
contents data. 

According to the present invention, the contents synthesizing apparatus obtains 
another synthesizing script indicated by the location information included in the 
synthesizing script representing the location of the said another synthesizing script, and 
the obtained another synthesizing script is added to the synthesized contents data. 
Therefore, the synthesizing process can be controlled from the side of the newly 
synthesized contents data. 

Preferably, the first contents data and the second contents data include key 
frames defining frames of animation data; and the synthesizing script includes a script 
describing that data included in a key frame included in the second contents data should 
be inserted to a prescribed key frame of the first contents data. 

According to the present invention, by the contents synthesizing apparatus, 
based on the synthesizing script including a script describing that the data included in a 
key frame of the second contents data should be inserted to a prescribed key frame of 
the first contents data, the data included in the key frame included in the input second 
contents data is inserted to the prescribed key frame of the input first contents data. 
Therefore, by the synthesizing script included in the first contents data, the synthesizing 



process of inserting the data included in the second contents data into the first contents 
data can be controlled. As a result, the synthesizing process of inserting other contents 
data can be controlled from the side of the contents data. 

Preferably, the first contents data and the second contents data include key 
5 frames defining frames of animation data; and the synthesizing script includes a script 
describing that a key frame included in the second contents data should be added to a 
prescribed portion of the first contents data. 

According to the present invention, by the contents synthesizing apparatus, 
based on the synthesizing script including a script describing that a key frame included in 

10 the second contents data should be added to a prescribed position of the first contents 
data, the key frame included in the input second contents is added to a prescribed 
position of the first contents data including a key frame. Therefore, by the synthesizing 
script included in the first contents data, the synthesizing process of adding the second 
contents data to the first contents data can be controlled. As a result, the synthesizing 

15 process of adding other contents data can be controlled from the side of the contents 
data. 

Preferably, the first contents data includes a key frame defining a frame of 
animation data; the second contents data is data that can be included in the key frame; 
and the synthesizing script includes a script describing that prescribed data included in 

20 the key frame of the first contents data should be changed to the second contents data. 

According to the present invention, by the contents synthesizing apparatus, 
based on the synthesizing script including a script describing that prescribed data 
included in a key frame of the first contents data should be changed to the second 
contents data, the prescribed data included in the key frame of the input first contents 

25 data is changed to the input second contents data. Therefore, by the synthesizing script 
included in the first contents data, the synthesizing process of changing the prescribed 
data included in the first contents data to the second contents data can be controlled. 
As a result, the synthesizing process of changing to other contents data can be 



L 



controlled from the side of the contents data. 

Preferably, the synthesizing script includes a script describing that a prescribed 
portion of the first contents data should be deleted. 

According to the present invention, by the contents synthesizing apparatus, 
5 based on the synthesizing script including a script describing that a prescribed portion of 
the first contents data should be deleted, the prescribed portion of the input first 
contents data is deleted. Therefore, by the synthesizing script included in the first 
contents data, the synthesizing process of deleting the prescribed portion included in the 
first contents data can be controlled. As a result, the synthesizing process of deleting a 
10 prescribed portion of the contents data can be controlled from the side of the contents 
data. 

According to another aspect, the present invention provides a contents 
synthesizing apparatus, including: an input receiving portion receiving an input of first 
contents data including location information indicating location of a synthesizing script 
15 describing synthesis of contents data and an input of second contents data; obtaining 

portion obtaining a synthesizing script indicated by the location information included in 
the input first contents data; and a synthesis processing portion synthesizing the input 
first contents data with the input second contents data, based on the obtained 
synthesizing script. 

20 According to the present invention, the contents synthesizing apparatus receives 

inputs of the first contents data including location information indicating location of the 
synthesizing script describing synthesis of contents data and the second contents data; 
the synthesizing script indicated by the location information included in the input first 
contents data is obtained; and based on the obtained synthesizing script, the input first 

25 contents data is synthesized with the input second contents data. Therefore, by the 
synthesizing script included in the first contents data, the synthesizing process is 
controlled. Further, as the first contents data includes the location information of the 
synthesizing script, it is unnecessary to newly prepare the synthesizing script when the 
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first contents data is to be synthesized with the second contents data. As a result, a 
contents synthesizing apparatus can be provided that enables control of the synthesizing 
process from the side of the contents data and eliminates the necessity of newly 
preparing the synthesizing script required for synthesizing contents data. 
5 Preferably, the synthesizing script includes location information indicating 

location of another synthesizing script; and the obtaining portion further obtains another 
synthesizing script indicated by the location information; and the apparatus further 
includes an adding portion having the obtained another synthesizing script included in 
the synthesized contents data. 

10 According to the present invention, the contents synthesizing apparatus obtains 

another synthesizing script indicated by the location information included in the 
synthesizing script indicating location of another synthesizing script, and the thus 
obtained another synthesizing script is added to the synthesized contents data. 
Therefore, the synthesizing process can be controlled from the side of the newly 

15 synthesized contents data. 

According to a still further aspect, the present invention provides a contents 
synthesizing method of synthesizing contents by a computer, including the steps of: 
receiving an input of first contents data including a synthesizing script and an input of 
second contents data; and synthesizing the input first contents data with the input 

20 second contents data, based on the synthesizing script included in the input first contents 
data. 

According to the present invention, a method of synthesizing contents that 
enables control of the synthesizing process from the side of the contents data and that 
eliminates the necessity of newly preparing the synthesizing script required for 
25 synthesizing contents data can be provided. 

According to a still further aspect, the present invention provides a contents 
synthesizing method of synthesizing contents by a computer, including the steps of: 
receiving an input of first contents data including location information indicating 
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location of a synthesizing script and an input of second contents data; obtaining the 
synthesizing script indicated by the location information included in the input first 
contents data; and synthesizing the input first contents data with the input second 
contents data, based on the obtained synthesizing script. 

According to the present invention, a method of synthesizing contents that 
enables control of the synthesizing process from the side of the contents data and that 
eliminates the necessity of newly preparing the synthesizing script required for 
synthesizing contents data can be provided. 

According to a still further aspect, the present invention provides a contents 
synthesizing program, causing a computer to execute the steps of receiving an input of 
first contents data including a synthesizing script and an input of second contents data; 
and synthesizing the input first contents data with the input second contents data, based 
on the synthesizing script included in the input first contents data. 

According to the present invention, a contents synthesizing program and a 
computer readable recording medium having the contents synthesizing program 
recorded thereon that enable control of the synthesizing process from the side of the 
contents data and that eliminate the necessity of newly preparing the synthesizing script 
required for synthesizing contents data can be provided. 

According to a still further aspect, the present invention provides a contents 
synthesizing program, causing a computer to execute the steps of receiving an input of 
first contents data including location information indicating location of a synthesizing 
script and an input of second contents data; obtaining the synthesizing script indicated 
by the location information included in the input first contents data; and synthesizing the 
input first contents data with the input second contents data, based on the obtained 
synthesizing script. 

According to the present invention, a contents synthesizing program and a 
computer readable recording medium having the contents synthesizing program 
recorded thereon that enable control of the synthesizing process from the side of the 



contents data and that eliminate the necessity of newly preparing the synthesizing script 

required for synthesizing contents data can be provided. 

According to a still further aspect, a data structure of contents data includes 

contents data, and a synthesizing script used when a synthesizing process of synthesizing 
5 the contents data with another contents data is executed by a computer. 

According to the present invention, by the synthesizing script included in the 

contents data, the synthesizing process of synthesizing contents data with other contents 

data can be executed by a computer. As a result, data structure of contents data and a 

computer readable recording medium having the contents data recorded thereon that 
10 enable control of the synthesizing process from the side of the contents data and that 

eliminate the necessity of newly preparing the synthesizing script required for 

synthesizing contents data can be provided. 

Preferably, the contents data and another contents data include key frames 

defining frames of animation data; and the synthesizing script includes a script describing 
15 that a key frame included in the said another contents data should be added to a 

prescribed portion of the contents data. 

According to the present invention, by the computer, based on the synthesizing 

script including a script describing that a key frame included in the said another contents 

data should be added to a prescribed position of the contents data, the key frame 
20 included in the input another contents data is added to a prescribed position of the input 

contents data. Therefore, by the synthesizing script included in the contents data, the 

synthesizing process of adding another contents data to the contents data can be 

controlled. As a result, the synthesizing process of adding another contents data can be 

controlled from the side of the contents data. 
25 Preferably, the contents data includes a key frame defining a frame of animation 

data; and the said another contents data is data that can be included in the key frame; 

and the synthesizing script includes a script describing that prescribed data included in 

the key frame of the contents data should be changed to the said another contents data. 
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According to the present invention, by the computer, based on the synthesizing 
script including a script describing that prescribed data included in a key frame of the 
contents data should be changed to another contents data, the prescribed data included 
in the key frame of the input contents data is changed to the input another data. 
5 Therefore, by the synthesizing script included in the contents data, the synthesizing 
process of changing the prescribed data included in the contents data to another 
contents data can be controlled. As a result, the synthesizing process of changing to 
another contents data can be controlled from the side of the contents data. 

Preferably, the synthesizing script includes a script describing that a prescribed 
10 portion of the contents data should be deleted. 

According to the present invention, by the computer, based on the synthesizing 
script including a script describing that a prescribed portion of the contents data should 
be deleted, the prescribed portion of the input contents data is deleted. Therefore, by 
the synthesizing script included in the contents data, the synthesizing process of deleting 
15 the prescribed portion included in the contents data can be controlled. As a result, the 
synthesizing process of deleting a prescribed portion of the contents data can be 
controlled from the side of the contents data. 

The foregoing and other objects, features, aspects and advantages of the present 
invention will become more apparent from the following detailed description of the 
20 present invention when taken in conjunction with the accompanying drawings. 

Brief Description of the Drawings 

Fig. 1 is a block diagram showing a schematic configuration of a contents 
synthesizing apparatus in accordance with a first embodiment. 
25 Fig. 2 schematically shows functions of the contents synthesizing apparatus in 

accordance with the first embodiment. 

Fig. 3 is a flowchart representing a flow of a contents synthesizing process 
executed by the contents synthesizing apparatus in accordance with the first embodiment. 
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Figs. 4A and 4B show data structures of the contents data before synthesis, in 
the first example of synthesis in accordance with the first embodiment. 

Fig. 5 shows data structure of the contents data after synthesis, in the first 
example of synthesis in accordance with the first embodiment. 

Figs. 6 A, 6B, 6C and 6D illustrate animation displayed when the contents data 
synthesized in accordance with the first example of synthesis of the first embodiment are 
reproduced. 

Figs. 7A and 7B show data structures of the contents data before synthesis, in 
the second example of synthesis in accordance with the first embodiment. 

Fig. 8 shows data structure of the contents data after synthesis, in the second 
example of synthesis in accordance with the first embodiment. 

Figs. 9A, 9B, 9C and 9D illustrate animation displayed when the contents data 
synthesized in accordance with the second example of synthesis of the first embodiment 
are reproduced. 

Figs. 1 OA and 10B show data structures of the contents data before synthesis, in 
the third example of synthesis in accordance with the first embodiment. 

Fig. 1 1 shows data structure of the contents data after synthesis, in the third 
example of synthesis in accordance with the first embodiment. 

Figs. 12 A and 12B show data structures of the contents data before synthesis, in 
the fourth example of synthesis in accordance with the first embodiment. 

Fig. 13 shows data structure of the contents data after synthesis, in the fourth 
example of synthesis in accordance with the first embodiment. 

Fig. 14 schematically shows functions of the contents synthesizing apparatus in 
accordance with a second embodiment. 

Fig. 15 is a flowchart representing a flow of a contents synthesizing process 
executed by the contents synthesizing apparatus in accordance with the second 
embodiment. 

Fig. 16 is a flowchart representing a flow of an attribute determining process 
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executed by the contents synthesizing apparatus in accordance with the second 
embodiment. 

Figs. 17A, 17B and 17C show data structures of the contents data before 
synthesis, in the first example of synthesis in accordance with the second embodiment. 

Figs. 18 A, 18B, 18C, 18D, 18E, and 18F illustrate animation displayed when the 
contents data synthesized in accordance with the first example of synthesis of the second 
embodiment are reproduced. 

Fig. 19 schematically shows functions of the contents synthesizing apparatus in 
accordance with a third embodiment. 

Fig. 20 is a flowchart representing a flow of a data synthesizing process executed 
by the contents synthesizing apparatus in accordance with the third embodiment. 

Figs. 21 A and 2 IB show data structures of the contents data before synthesis, in 
the first example of synthesis in accordance with the third embodiment. 

Figs. 22A, 22B, 22C, 22D, 22E, and 22F illustrate animation displayed when the 
contents data synthesized in accordance with the first example of synthesis of the third 
embodiment are reproduced. 

Fig. 23 schematically shows functions of the contents synthesizing apparatus in 
accordance with a fourth embodiment. 

Fig. 24 is a flowchart representing a flow of a data synthesizing process executed 
by the contents synthesizing apparatus in accordance with the fourth embodiment. 

Figs. 25 A and 25B show data structures of the contents data before synthesis, in 
the first example of synthesis in accordance with the fourth embodiment. 

Fig. 26 is a flowchart representing a flow of a data synthesizing process executed 
by the contents synthesizing apparatus in accordance with the fifth embodiment. 

Figs. 27A and 27B show data structures of the contents data before synthesis, in 
the first example of synthesis in accordance with the fifth embodiment. 

Fig. 28 shows data structure of the contents data after synthesis, in the first 
example of synthesis in accordance with the fifth embodiment. 
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Figs. 29A and 29B show data structures of the contents data before synthesis, in 
the second example of synthesis in accordance with the fifth embodiment. 

Fig. 30 shows data structure of the contents data after synthesis, in the second 
example of synthesis in accordance with the fifth embodiment. 

Figs. 3 1 A and 3 IB show data structures of the contents data before synthesis, in 
the third example of synthesis in accordance with the fifth embodiment. 

Fig. 32 shows data structure of the contents data after synthesis, in the third 
example of synthesis in accordance with the fifth embodiment. 

Fig. 33 schematically shows functions of the contents synthesizing apparatus in 
accordance with a sixth embodiment. 

Fig. 34 is a flowchart representing a flow of a data synthesizing process executed 
by the contents synthesizing apparatus in accordance with the sixth embodiment. 

Best Modes for Carrying Out the Invention 
[First Embodiment] 

In the following, embodiments of the present invention will be described with 
reference to the figures. In the figures, the same reference characters denote the same 
or corresponding portions, and repetitive descriptions will not be given. 

Fig. 1 is a block diagram schematically showing a configuration of a contents 
synthesizing apparatus 100 in accordance with the first embodiment. Referring to Fig. 
1, contents synthesizing apparatus 100 can be implemented by a general-purpose 
computer such as a personal computer (hereinafter denoted by "PC (personal 
computer)"). Contents synthesizing apparatus 100 includes: a control portion 1 10 for 
overall control of contents synthesizing apparatus 100; a storage portion 130 for storing 
prescribed information; an input portion 140 for inputting prescribed information to 
contents synthesizing apparatus 100; an output portion 150 for outputting prescribed 
information from contents synthesizing apparatus 100; a communication portion 160 as 
an interface for connecting contents synthesizing apparatus 100 to a network 500; and 
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an external storage apparatus 1 70 for inputting information recorded on a recording 
medium 171 or for recording necessary information on recording medium 171. Further, 
control portion 1 10, storage portion 130, input portion 140, output portion 150, 
communication portion 160, and external storage apparatus 170 are connected to each 
5 other through a bus. 

Control portion 110 includes a CPU (Central Processing Unit) and auxiliary 
circuitry for the CPU, and it controls storage portion 130, input portion 140, output 
portion 150, and external storage apparatus 170, executes a prescribed process in 
accordance with a program stored in storage portion 130, processes data input from 
10 input portion 140, communication portion 160 and external storage apparatus 170, and 
outputs the processed data to output portion 150, communication portion 160 or to 
external storage apparatus 170. 

Storage portion 130 includes an RAM (Random Access Memory) used as a 
work area necessary for control portion 1 10 to execute a program, and an ROM (Read 
15 Only Memory) for storing a program to be executed by control portion 1 10. Further, a 
magnetic disk storage apparatus such as a hard disk drive (hereinafter referred to as 
"HDD (Hard Disk Drive)" is used supplementary to the RAM. 

Input portion 140 is an interface for inputting a signal from a keyboard, mouse 
or the like, which enables input of necessary information to contents synthesizing 
20 apparatus 100. 

Output portion 150 is an interface for outputting a signal to a display such as a 
liquid crystal display or cathode ray tube (hereinafter referred to as a "CRT (Cathode 
Ray Tube)", which enables output of necessary information from contents synthesizing 
apparatus 100. 

25 Communication portion 160 is a communication interface for connecting 

contents synthesizing apparatus 100 to network 500. Contents synthesizing apparatus 
100 transmits/receives necessary information to and from other PCs and the like, 
through communication portion 160. 
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External storage apparatus 1 70 reads program or data recorded on recording 
medium 171, and transmits the same to control portion 110. Further, external storage 
apparatus 170 writes necessary information to recording medium 171 in accordance 
with an instruction from control portion 1 10. 
5 Computer readable recording medium 171 refers to a recording medium that 

fixedly carries a program, including a magnetic tape, a cassette tape, a magnetic disk 
such as a floppy (R) disk or hard disk, an optical disk such as a CD-ROM (Compact 
Disk Read Only Memory) or DVD (Digital Versatile Disk), a magneto-optical disk such 
as an MO (Magneto Optical disk) or an MD (Mini Disk), a memory card such as an IC 
10 card or an optical card, and a semiconductor memory such as a mask ROM, EPROM 
(Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable and 
Programmable Read Only Memory) or a flash ROM. The recording medium may be 
one that carries a program in a flowing manner, for a program downloaded from 
network 500. 

15 Fig. 2 schematically shows functions of contents synthesizing apparatus 100 in 

accordance with the first embodiment. Referring to Fig. 2, control portion 1 10 of 
contents synthesizing apparatus 100 includes an input receiving portion 1 1 1 and a 
synthesis processing portion 1 12. Storage portion 130 of contents synthesizing 
apparatus 100 stores a plurality of contents data. The contents data include contents 

20 data including animation data and a synthesizing script, and contents data including 
animation data. 

The contents data may include motion picture data such as animation data, still 
image data, music data, figure data and the like, that can be output by a contents 
reproducing apparatus such as a computer. Here, an example will be described in 
25 which the contents data includes animation data, though it is not limiting. The 
animation data include a key frame that defines each frame of animation data. 

. The synthesizing script refers to information defining a procedure in a 
synthesizing process for synthesizing certain contents data with other contents data, and 
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it is used when the synthesizing process is executed by contents synthesizing apparatus 
100. The synthesizing script includes control contents and a parameter. The control 
contents represent the contents of synthesizing process. The parameter indicates the 
object of the synthesizing process. In the present embodiment, an example is discussed 
in which the contents data include animation data, and therefore, the synthesizing script 
is information defining the procedure in a synthesizing process in which animation data 
is synthesized with other animation data. 

The contents data stored in storage portion 130 may be received in advance from 
other PC or the like through network 500 by communication portion 160 and stored in 
storage portion 130, or may be read from recording medium 171 by external storage 
apparatus 170 and stored in storage portion 130. 

Input receiving portion 1 1 1 receives input of contents data 10 including the 
synthesizing script and contents data 20, stored in storage portion 130. The received 
contents data 10 and 20 are output to synthesis processing portion 112. Input 
receiving portion 1 1 1 may receive input of contents data 10 including the synthesizing 
script and the contents data 20 directly by communication portion 160 from other PC or 
the like through network 500, or may receive input of contents data 10 including the 
synthesizing script and the contents data 20 from recording medium 171 by external 
storage apparatus 170. 

Synthesis processing portion 112 synthesizes the animation data included in 
contents data 10 with the animation data included in contents data 20, in accordance 
with the synthesizing script included in contents data 10. Then, synthesis processing 
portion 121 has the synthesized contents data 30 stored in storage portion 130. It is 
noted that synthesis processing portion 1 12 may transmit the synthesized contents data 
30 directly to other PC or the like by communication portion 160 through network 500, 
or may have the synthesized contents data 30 recorded on recording medium 171 using 
external storage apparatus 170. 

Fig. 3 is a flow chart representing the flow of contents synthesizing process 
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executed by contents synthesizing apparatus 100 in accordance with the first 
embodiment. Referring to Fig. 3, first, in step SI 1, input receiving portion 1 1 1 
receives input of contents data 10 including the synthesizing script and contents data 20, 
stored in storage portion 130. 
5 Then, in step SI 2, synthesis processing portion 1 12 determines whether the 

contents data 10 or 20 input in step SI 1 includes the synthesizing script. When either 
of the contents data includes the synthesizing script (Yes in step SI 1), the flow proceeds 
to step S13. When neither of contents data include the synthesizing script (No in step 
SI 1), the contents synthesizing process ends. Here, contents data 10 input in step SI 1 

10 includes the synthesizing script, and therefore, the flow proceeds to step S13 . When 
both contents data include the synthesizing script, the contents synthesis process may be 
terminated, or, alternatively, the synthesizing script included in either one of the contents 
data may be used in the following steps. 

In step SI 3, data synthesizing process is executed by synthesis processing 

15 portion 1 12. The data synthesizing process refers to a process of synthesizing the 

animation data included in contents data 10 with the animation data included in contents 
data 20 input in step SI 1, based on the synthesizing script included in contents data 10 
input in step S 1 1 . 

Finally, in step SI 4, the contents data 30 synthesized by synthesis processing 
20 portion 1 12 in step S13 is stored in storage portion 130, and the contents synthesizing 
process ends. 

(First Example of Synthesis in Accordance with the First Embodiment) 
Here, an example of synthesis will be described in which, based on the 
synthesizing script included in a contents data, data included in another contents data is 
25 inserted to the contents data. 

Figs. 4A and 4B show data structures of the contents data before synthesis, in 
the first example of synthesis in accordance with the first embodiment. Fig. 4A shows 
data structure of contents data 1 A including the synthesizing script. Referring to Fig. 
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4A, contents data 1 A includes a header, key frames 1 to 4, and the synthesizing script. 

The header includes data representing attributes of the animation data, such as 
display size, number of key frames and reproduction time interval of each key frame, of 
the animation data. The key frame refers to data that defines a frame of the animation 
5 data. From the reproduction time interval of each key frames, the time when each key 
frame is reproduced is determined. Then, in accordance with the frame rate indicating 
the number of frames that can be reproduced per one second by the reproducing 
apparatus reproducing the animation data, frames between the key frames are 
interpolated. Then, the key frames and the interpolated frames are successively 

10 reproduced, realizing the animation. 

Key frame 1 includes object data and image data. The object data represents a 
figure, consisting of shape data representing the shape of the figure, and position data 
representing the position of the figure. Here, the object data represents that the figure 
has a circular shape and that the figure is positioned at an upper portion of the image 

15 plane, slightly left from the center. In the following, for easier visual understanding, 
the object data will be represented by an image of the figure defined by the object data 
displayed on the image plane. The image data refers to data of the image displayed on 
the background of the animation, such as a pattern, picture, or photograph image, 
encoded in a prescribed coding format. The image data is kept displayed until a key 

20 frame including different image data is reproduced. 

Key frame 2 includes object data and music data. The object data represents 
the same figure as that represented by the object data included in key frame 1, and 
therefore, these object data are related to each other. Here, the object data represents 
that the figure is positioned at an upper portion of the image plane, slightly left from the 

25 center. The music data is to generate sound as the animation proceeds, representing 
music or sound effect encoded in a prescribed coding format allowing generation of 
sound by the computer. The music data continuously generates the same music until a 
key frame including different music data is reproduced. 
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Key frames 3 and 4 respectively include object data. These object data 
represent the same figure as that represented by the object data included in key frames 1 
and 2, and therefore, these object data are related to each other. Specifically, the 
object data included in key frames 1 to 4 are related to each other among key frames. 
5 Therefore, when the animation data is reproduced, the figure represented by the object 
data is displayed as an animation of the figure, along with the progress of key frames. 
Such a method of animation is referred to as vector animation method. 

Here, the object data included in key frame 3 represents that the figure is at a 
slightly lower portion from the center of the image plane, slightly left from the center. 

10 Further, the object data included in key frame 4 represents that the figure is slightly left 
from the center of the image plane. Specifically, when key frames 1 to 4 are 
reproduced, the circular figure first appears at an upper portion of the image plane, 
slightly left from the center, stays at the same position for a while, then moves 
downward to a portion slightly lower than the center, and again moves upward near to 

15 the center. 

The synthesizing script included in contents data 1 A includes, as control contents, 
"insertion of an object from another file", and as a parameter, "key frame 2~ " The 
control contents "insertion of an object from another file" indicates that the object data 
included in the animation data of another contents data 2A should be inserted to the 
20 target position designated by the parameter. The parameter "key frame 2~" represents 
that the target position of synthesizing process indicated by the control contents is from 
key frame 2 of the animation data included in contents data 1 A including the 
synthesizing script. 

Fig. 4B represents data structure of contents data 2A. Referring to Fig. 4B, 
25 contents data 2 A includes a header and key frame 1 data ~ key frame 2. 

Key frames 1 and 2 include object data. Here, the object data represents that 
the figure has a square shape and that the figure is positioned slightly lower than the 
center of the image plane. Further, the object data included in the key frame represents 
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the same figure as that represented by the object data included in key frame 1, and that 
the figure is positioned slightly upper than the center of the image plane. 

Contents synthesizing apparatus 100 receives inputs of contents data 1A and 2 A, 
and whether contents data 1 A or 2 A includes a synthesizing script or not is determined. 
5 As contents data 1 A includes the synthesizing script, the animation data included in 

contents data 1 A is synthesized with animation data included in contents data 2 A based 
on the synthesizing script, and contents data 3 A, which will be described later, is stored. 

The synthesizing script describes that to each key frame from key frame 2 of 
contents data 1 A including the synthesizing script, the object data included in each key 
10 frame of contents data 2A is to be inserted. 

Therefore, contents synthesizing apparatus 100 provides key frame 1 of contents 
data 1 A as a new key frame 1 . 

Then, the object data included in key frame 1 of contents data 2 A is inserted to 
key frame 2 of contents data 1 A, to provide a new key frame 2. 
15 Then, the object data included in key frame 2 of contents data 2A is inserted to 

key frame 3 of contents data 1 A, to provide a new key frame 3. 

Next, key frame 4 of contents data 1 A is provided as a new key frame 4. 

Finally, based on the new key frames 1 to 4, a header is generated, and contents 
data 3A including the header and the new key frames 1 to 4 is synthesized and stored. 
20 Fig. 5 shows a data structure of contents data 3A synthesized in accordance with 

the first example of synthesis of the first embodiment. Referring to Fig. 5, contents 
data 3 A having contents data 1 A and contents data 2 A synthesized by contents 
synthesizing apparatus 100 consists of the header and key frames 1 to 4. 

The header is generated based on the key frames 1 to 4 of synthesized contents 
25 data 3 A and is included in contents data 3A. 

Key frame 1 is the same as key frame 1 of contents data 1 A described with 
reference to Fig. 4 A. 

Key frame 2 is the key frame 2 of contents data 1 A, having the object data 
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included in key frame 1 of contents data 2A described with reference to Fig. 4B inserted. 

Key frame 3 is the key frame 3 of contents data 1 A, having the object data 
included in key frame 2 of contents data 2 A inserted. 

Key frame 4 is the same as key frame 4 of contents data 1 A. 
5 Figs. 6 A, 6B, 6C and 6D illustrate an animation displayed when contents data 

3 A synthesized in accordance with the first example of synthesis of the first embodiment 
is reproduced. Figs. 6A to 6D show displayed images corresponding to respective key 
frames reproduced successively. Referring to Fig. 6 A, first, in key frame 1, a circular 
figure is displayed at an upper portion of the image plane slightly left from the center, 
10 and an image A represented by image data is displayed as a background. Between key 
frames 1 and 2, the image displayed in the first key frame is kept continuously displayed. 

Referring to Fig. 6B, in key frame 2, a square figure is additionally displayed at a 
portion slightly lower than the center of the image plane, and music A represented by 
music data starts. Between key frames 2 and 3, the circular figure moves downward, 
15 while the square figure moves upward. 

Referring to Fig. 6C, in key frame 3, the circular figure is displayed at a portion 
slightly lower than and slightly left from the center of the image plane, and the square 
figure is displayed at a portion slightly upper than the center of the image plane. 
Between key frames 3 and 4, the circular figure moves upward and the square figure 
20 disappears gradually. 

Referring to Fig. 6D, in key frame 4, the circular figure stops at a portion slightly 
left from the center of the image plane, and the square figure disappears completely. 
Though not shown in Figs. 6A to 6D, when contents data 3 A is reproduced by the 
reproducing apparatus, between the displayed images corresponding to respective 
25 frames, an image plane corresponding to an interpolated frame is displayed. 

In this manner, the synthesizing script included in contents data 1A controls the 
synthesizing process of inserting the object data included in contents data 2 into contents 
data 1A. As a result, the synthesizing process of inserting other contents data 2 A can 
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be controlled from the side of contents data 1 A. 

(Second Example of Synthesis in Accordance with the First Embodiment) 

Here, an example of synthesis of inserting prescribed data to a contents data will 
be described, in which based on a synthesizing script included in the contents data, data 
5 included in another contents data is inserted to the contents data. 

Figs. 7A and 7B show data structures of the contents data before synthesis, in 
the second example of synthesis in accordance with the first embodiment. Fig. 7A 
represents data structure of contents data IB including the synthesizing script. 
Referring to Fig. 7 A, contents data IB includes a header, key frames 1 to 4, and the 
10 synthesizing script. 

Key frames 1 to 4 each include an object data. These object data are similar to 
the object data included in key frames 1 to 4 of contents data 1 A described with 
reference to Fig. 4A, and therefore, description thereof will not be repeated. 

The synthesizing script included in contents data IB includes, as the first control 
15 contents, "insertion of object of another file," and as the first parameter, "key frame 2~" 
Further, it includes, as the second control contents, "insertion of control data," and as 
the second parameter, "(jump to 4) key frame 2." As "insertion of object of another 
file" has already been described with reference to Fig. 4 A, description thereof will not be 
repeated. The control contents "insertion of control data" represents insertion of the 
20 target data designated by the parameter in the parenthesis into the target position 

designated by the parameter outside the parenthesis. The parameter, "(jump to 4) key 
frame 2" indicates that the target data of the synthesizing process represented by the 
control contents is the control data "jump to 4" and that the target position of the 
synthesizing process represented by the control contents is key frame 2 of the animation 
25 data included in contents data IB that includes the synthesizing script. 

The control data refers to data for controlling the reproducing apparatus when 
the key frames of the animation data are reproduced. When the control data is 
included in the key frames of the contents data, the reproducing apparatus reproduces 
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the key frames based on the control data, at the time of reproduction. 

Fig. 7B represents data structure of contents data 2B. Contents data 2B shown 

in Fig. 7B is the same as contents data 2A described with reference to Fig. 4B, and 

therefore, description thereof will not be repeated. 
5 Contents synthesizing apparatus 100 receives inputs of contents data IB and 2B, 

and whether contents data IB or 2B includes a synthesizing script or not is determined. 

As contents data 1 A includes the synthesizing script, the animation data included in 

contents data IB is synthesized with animation data included in contents data 2B based 

on the synthesizing script, and contents data 3B, which will be described later, is stored. 
10 Synthesizing script describes that to each key frame starting from key frame 2 of 

animation data IB including the synthesizing script, the object data included in each key 

frame of the other animation data 2B, which will be described later, is to be inserted, and 

that the control data "jump to 4" designating a jump to key frame 4 is to be inserted to 

key frame 2 of animation data IB. 
15 Therefore, contents synthesizing apparatus 100 provides key frame 1 of contents 

data IB as a new key frame 1. 

Thereafter, the object data included in key frame 1 of contents data 2B and the 

control data "jump to 4" are inserted to key frame 2 of contents data IB, to provide a 

new key frame 2. 

20 Then, the object data included in key frame 2 of contents data 2B is inserted to 

key frame 3 of contents data IB, to provide key frame 3 of contents data 3B. 
Next, key frame 4 of contents data IB will be a new key frame 4. 
Finally, based on the new key frames 1 to 4, a header is generated, and contents 
data 3B including the header and the new key frames 1 to 4 is synthesized and stored. 
25 Fig. 8 shows data structure of the contents data 3B after synthesis, in the second 

example of synthesis in accordance with the first embodiment. Referring to Fig. 8, 
contents data 3B having contents data IB and contents data 2B synthesized by contents 
synthesizing apparatus 100 consists of the header and key frames 1 to 4. The header 
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has already been described with reference to Fig. 5, and therefore, description will not 
be repeated. 

Key frame 1 is the same as key frame 1 of contents data IB described with 
reference to Fig. 7A. 

5 Key frame 2 is the key frame 2 of contents data IB, having the object data 

included in key frame 1 of contents data 2B described with reference to Fig. 7B inserted, 
and having control data "jump to 4" inserted. 

Key frame 3 is the key frame 3 of contents data IB having the object data 
included in key frame 2 of contents data 2B inserted. 
10 Key frame 4 is the same as key frame 4 of contents data IB. 

Figs. 9 A, 9B, 9C and 9D illustrate an animation displayed when contents data 3B 
synthesized in accordance with the second example of synthesis of the first embodiment 
is reproduced. Figs. 9 A to 9D show displayed images corresponding to respective key 
frames reproduced successively. Referring to Fig. 9 A, first, in key frame 1, a circular 
15 figure is displayed at an upper portion of the image plane slightly left from the center. 
Between key frames 1 and 2, the image displayed in the first key frame is kept 
continuously displayed, 

Referring to Fig. 9B, in key frame 2, a square figure is additionally displayed at a 
portion slightly lower than the center of the image plane. Referring to Fig. 9C, in 
20 accordance with the control data "jump to 4", the key frame 3 is excluded from the 
object of reproduction. Between key frames 2 and 4, the circular figure moves 
downward, while the square figure disappears gradually. 

Referring to Fig. 9D, in key frame 4, the circular figure stops at a portion slightly 
left from the center of the image plane, and the square figure disappears completely. 
25 In this manner, the synthesizing script including a plurality of scripts included in 

contents data IB controls the synthesizing process of synthesizing the object data 
included in contents data 2B with contents data IB. As a result, the synthesizing 
process of synthesizing with the other contents data 2B can be controlled from the side 
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of contents data IB. 

(Third Example of Synthesis in Accordance with the First Embodiment) 
Here, an example of synthesis will be described in which, based on the 
synthesizing script included in a contents data, another contents data is inserted to the 
5 contents data. 

Figs. 10A and 10B show data structures of the contents data before synthesis, in 
the third example of synthesis in accordance with the first embodiment. Fig. 10A 
represents data structure of contents data 1C including the synthesizing script. 
Referring to Fig. 10A, contents data 1C includes a header, key frames 1 and 2, and the 
10 synthesizing script. 

Key frames 1 and 2 are similar to the object data included in key frames 2 and 3 
of contents data IB described with reference to Fig. 7 A, respectively, and therefore, 
description thereof will not be repeated. 

The synthesizing script included in contents data 2C includes, as control contents, 
15 "addition of key frame," and as a parameter, "before key frame 1 " The control 

contents "addition of key frame" indicates that each key frame included in the animation 
data included in another contents data 2C is to be inserted to the target position 
designated by the parameter. The parameter "before key frame 1" represents that the 
target position of synthesizing process indicated by the control contents is before the key 
20 frame 1 of the animation data included in contents data 1C including the synthesizing 
script. 

Fig. 10B represents data structure of contents data 2C. Referring to Fig. 10B, 
contents data 2C is the same as contents data 2B described with reference to Fig. 7B, 
and therefore, description thereof will not be repeated. 
25 Contents synthesizing apparatus 100 receives inputs of contents data 1C and 2C, 

and whether contents data 1C or 2C includes a synthesizing script or not is determined. 
As contents data 1C includes the synthesizing script, the animation data included in 
contents data 1C is synthesized with animation data included in contents data 2C based 
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on the synthesizing script, and contents data 3C, which will be described later, is stored. 

The synthesizing script describes that the key frame included in contents data 2C 
should be added before key frame 1 of contents data 1C including the synthesizing script. 

Therefore, contents synthesizing apparatus 100 adds key frames 1 and 2 of 
5 contents data 2C before key frame 1 of contents data 1C, to provide new key frames 1 
and 2. 

Then, key frames 1 and 2 of contents data 1C are provided as key frames 3 and 4 
of contents data 3C. 

Finally, based on the new key frames 1 to 4, a header is generated, and contents 
10 data 3C including the header and the new key frames 1 to 4 is synthesized and stored. 

Fig. 1 1 shows data structure of the contents data 3C after synthesis, in the third 
example of synthesis in accordance with the first embodiment. Referring to Fig. 1 1, 
contents data 3C having contents data 1C and contents data 2C synthesized by contents 
synthesizing apparatus 100 consists of the header and key frames 1 to 4. 
15 Key frames 1 and 2 are the same as key frames 1 and 2 of contents data 2C 

described with reference to Fig. 10B. 

Key frames 3 and 4 are the same as key frames 1 and 2 of contents data 1C 
described with reference to Fig. 10A. 

In this manner, the synthesizing script included in contents data 1C controls the 
20 synthesizing process of adding the key frame included in contents data 2C to a 

prescribed position of contents data 1C. As a result, the synthesizing process of 
inserting another contents data 2C can be controlled from the side of contents data 1C. 

(Fourth Example of Synthesis in Accordance with the First Embodiment) 

Here, an example of synthesis will be described, in which based on a synthesizing 
25 script included in a contents data, data included in the contents data is replaced by 
another contents data. 

Figs. 12A and 12B show data structures of the contents data before synthesis, in 
the fourth example of synthesis in accordance with the first embodiment. Fig. 12A 
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represents data structure of contents data IE including the synthesizing script. 
Referring to Fig. 12A, contents data IE includes a header, key frames 1 and 2, and the 
synthesizing script. 

Key frames 1 and 2 include an object data A representing a face figure, an object 
5 data B representing a dialogue balloon figure, and text data A. 

Object data A included in key frame 1 represents that the face figure is at a lower 
left portion of the image plane. Further, object data A included in key frame 2 
represents that the face figure is at a lower right portion of the image plane. 

Object data B included in key frame 1 represents that the dialogue balloon figure 
10 is at an upper right portion of the image plane. Further, object data B included in key 
frame 2 represents that the dialogue balloon figure is at an upper portion of the image 
plane. 

Text data A included in key frames 1 and 2 represent that the text data A is 
positioned inside object data B. 

15 The synthesizing script included in contents data IE includes, as control contents, 

"change to data of another file/ 5 and as a parameter, "text data A." The control 
contents "change to data of another file" indicates that the target data designated by the 
parameter should be changed to the data included in another contents data 2E. The 
parameter "text data A" indicates that the target data of the synthesizing process 

20 represented by the control contents is the text data A included in the key frame of 
animation data included in contents data IE including the synthesizing script. 

Fig. 12B shows contents data 2E for the change. Referring to Fig. 12B, 
contents data 2E includes text data consisting of a string of letters "Hello, World!" 

Contents synthesizing apparatus 100 receives inputs of contents data IE and 2E, 

25 and whether contents data IE or 2E includes a synthesizing script or not is determined. 
As contents data IE includes the synthesizing script, contents data IE is synthesized 
with contents data 2E based on the synthesizing script, and contents data 3E, which will 
be described later, is stored. 
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The synthesizing script describes that the prescribed data included in the key 
frame of contents data IE should be changed to data included in contents data 2E. 

Therefore, based on the synthesizing script included in contents data IE, 
contents synthesizing apparatus 100 changes the text data A included in key frames 1 
5 and 2 of contents data IE to the text data consisting of a string of letters "Hello, 
World!" included in contents data 2E, to provide new key frames 1 and 2. 

Finally, based on the new key frames 1 and 2, a header is generated, and 
contents data 3E including the header and the new key frames 1 and 2 is synthesized and 
stored. 

10 Fig. 13 shows data structure of the contents data 3E after synthesis, in the fourth 

example of synthesis in accordance with the first embodiment. Referring to Fig. 13, 
contents data 3E having contents data IE and object data 2E synthesized by contents 
synthesizing apparatus 100 consists of the header and key frames 1 and 2. 

Key frames 1 and 2 correspond to key frames 1 and 2 of contents data IE 

15 described with reference to Fig. 12 A, with the text data A changed to the text data 
included in contents data 2E described with reference to Fig. 12B. 

In this manner, the synthesizing script included in contents data IE controls the 
synthesizing process of changing the prescribed data included in contents data IE to 
another data. 

20 As described above, in the contents synthesizing apparatus 100 in accordance 

with the first embodiment, input of the first contents data including the synthesizing 
script describing synthesis of contents data and input of the second contents data are 
received, and the input first contents data is synthesized with the input second contents 
data. Therefore, the synthesizing script included in the first contents data controls the 

25 synthesizing process. Further, as the synthesizing script is included in the first contents 
data, it is unnecessary to newly prepare the synthesizing script when the first contents 
data is to be synthesized with the second contents data. As a result, the synthesizing 
process can be controlled from the side of the contents data and the necessity of newly 
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preparing the synthesizing script required for synthesizing contents data can be 
eliminated. 

Though the process performed by contents synthesizing apparatus 100 has been 
described in the first embodiment, the present invention can also be implemented as a 
5 method of synthesizing contents executing the process shown in Fig. 3 on a computer, a 
contents synthesizing program for causing a computer to execute the process shown in 
Fig. 3, a computer readable recording medium recording the contents synthesizing 
program, data structure of the contents data shown in Figs. 4 A, 7 A, 10A and 12 A, and a 
computer readable recording medium recording the contents data having the data 
10 structure. 

[Second Embodiment] 

In the second embodiment, an example will be described in which the 
synthesizing script described with reference to the first embodiment includes scripts 
corresponding to a plurality of attributes respectively. 
15 Fig. 14 schematically shows a function of contents synthesizing apparatus 100 A 

in accordance with the second embodiment. Referring to Fig. 14, a control portion 
1 1 OA of contents synthesizing apparatus 100 A includes an input receiving portion 1 1 1, a 
synthesis processing portion 1 12 A, and an attribute determining portion 113. Storage 
portion 130 of contents synthesizing apparatus 100 stores a plurality of contents data. 
20 The contents data includes contents data including animation data and a synthesizing 
script, and contents data including animation data. 

Input receiving portion 1 1 1 has been described with reference to Fig. 2 of the 
first embodiment, and therefore, description thereof will not be repeated. 

When the synthesizing script included in contents data 1 0 includes scripts 
25 corresponding to a plurality of attributes of the animation data included in contents data 
20, respectively, synthesis processing portion 1 12A sends contents data 20 to attribute 
determining portion 113. 

Attribute determining portion 1 13 determines attributes of animation data 
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included in contents data 20 sent from synthesis processing portion 1 12 A, and returns 
the result of determination to synthesis processing portion 1 12 A. The attribute of 
animation data represents indexes showing the feature of animation data, such as the 
number of object data, number of key frames, number of image data and number of 
music data. 

Specifically, when the number of object data included in contents data 20 is W, 
the number of key frames is X, the number of image data is Y and the number of music 
data is Z, for example, attribute determining portion 1 13 returns a string of numbers 
WXYZ as the attribute of animation data included in contents data 20, to synthesis 
processing portion 1 12 A. The attributes of animation data are not limited thereto, and 
may include a number designated based on the contents of the animation data, 
information of the author of the animation data, a number uniquely allocated to the 
animation data, or a combination of these. 

Based on the scripts corresponding to the attributes of animation data included 
in contents data 20 indicated by the result of determination made by attribute 
determining portion 113, synthesis processing portion 1 12A synthesizes the animation 
data included in contents data 10 input through input receiving portion 1 1 1 with the 
animation data included in contents data 20. Synthesis processing portion 1 12A then 
has the synthesized contents data 30 stored in storage portion 130. Synthesis 
processing portion 1 12 A may directly transmit the synthesized contents data 30 to other 
PC or the like through network 500 using communication portion 160, or record the 
contents data on a recording medium 171, using external storage apparatus 170. 

Fig. 15 is a flowchart representing the flow of data synthesizing process 
executed by contents synthesizing apparatus 100 A in accordance with the second 
embodiment. The data synthesizing process is the process executed in step S13 of 
contents synthesizing process described with reference to Fig. 3. Referring to Fig. 15, 
first, in step S21, an attribute determining process for determining attributes of 
animation data included in contents data 20 input in step S 1 1 is executed, by attribute 



-31 - 



determining portion 113. The attribute determining process will be described later, 
with reference to Fig. 16. 

Next, in step S22, synthesis processing portion 1 12A determines whether the 
script corresponding to the attribute of animation data included in contents data 20 
determined in step S21 is included in the synthesizing script of contents data 10 or not. 
If the script corresponding to the attribute of animation data included in contents data 
20 is included in the synthesizing script of content data 10 (Yes in step S22), in step S23, 
synthesis processing portion 1 12A executes a synthesizing process of synthesizing 
contents data 10 input in step SI 1 with contents data 20 input in step SI 1, based on the 
script corresponding to the attribute of animation data included in contents data 20, as 
determined in step S21, and then the flow returns to the contents synthesizing process. 

If a script corresponding to the attribute of animation data included in contents 
data 20 is not included in the synthesizing script of contents data 10 (No in step S22), 
the flow returns to the contents synthesizing process. 

Fig. 16 is a flowchart representing the flow of attribute determining process 
executed by contents synthesizing apparatus 100 A in accordance with the second 
embodiment. The attribute determining process is executed by attribute determining 
portion 1 13 in step S21 of the data synthesizing process described with reference to Fig. 
15. Referring to Fig. 16, first in step S3 1, the number of objects W included in the key 
frame of contents data 20 is determined. In step S3 2, the number of key frames X 
included in contents data 20 is determined. 

In step S3 3, the number of image data Y included in the key frame of contents 
data 20 is determined. Further, in step S34, the number of music data Z included in the 
key frame of contents data 20 is determined. 

Finally, in step S35, based on the determination of steps S31 to S34, a string of 
numbers WXYZ is returned to the data synthesizing process, as the attribute of 
animation data defined by the key frames included in contents data 20. 

(First Example of Synthesis in Accordance with the Second Embodiment) 
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Here, an example of synthesis will be described, in which contents data is 
synthesized with another contents data, based on scripts corresponding to a plurality of 
attributes, included in the synthesizing script of the contents data. 

Figs. 17 A, 17B and 17C show data structures of the contents data before 
synthesis, in the first example of synthesis in accordance with the second embodiment. 
Fig. 17A shows the data structure of contents data IF including the synthesizing script. 
Referring to Fig. 17A, contents data IF includes a header, key frames 1 to 3, and the 
synthesizing script. 

Key frames 1 to 3 are similar to the object data included in key frames 2 to 4 of 
contents data IB described with reference to Fig. 7, and therefore, description thereof 
will not be repeated. 

The synthesizing script included in contents data IF includes a synthesizing 
script corresponding to the attribute "010300" and a synthesizing script corresponding 
to the attribute "010200". The synthesizing script corresponding to the attribute 
"010300" includes, as control contents, "insertion of an object from another file", and as 
a parameter, "key frame 1~" The synthesizing script corresponding to the attribute 
"010200" includes, as control contents, "insertion of an object from another file", and as 
a parameter, "key frame 2-". 

The control contents "insertion of an object from another file" and parameters 
"key frame 1~" and "key frame 2-" have already been described with reference to Fig. 
4A, and therefore, description thereof will not be repeated. 

The attribute "010300" indicates that the number of object data W included in 
the animation data is 01, the number of key frames X is 03, the number of image data Y 
is 0, and the number of music data Z is 0. Similarly, the attribute "010200" indicates 
that the numbers of object data, image data, and music data are the same as attribute 
"010300" while the number of key frames X is 02. 

Fig. 17B shows a data structure of contents data 2FA. Contents data 2FA 
shown in Fig. 17B is the same as contents data 2A described with reference to Fig. 4B, 
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and therefore, description thereof will not be repeated. Here, the number of object 
data W included in the animation data of contents data 2FA is 01, the number of key 
frames X is 02, the number of image data Y is 0 and the number of music data Z is 0, 
and therefore, the attribute of animation data included in contents data 2FA is "010200". 
5 Fig. 17C represents data structure of contents data 2FB. Referring to Fig. 17C, 

contents data 2FB includes a header and key frames 1 to 3. 

Key frames 1 and 2 are the same as key frames 1 and 2 of contents data 2A 
described with reference to Fig. 4B. 

Key frame 3 includes the object data representing the same figure as represented 
10 by the object data included in key frames 1 and 2, with the figure positioned at a lower 
center of the image plane. 

Here, the number of object data W included in the animation data of contents 
data 2FB is 01, the number of key frames X is 03, the number of image data Y is 0 and 
the number of music data Z is 0, and therefore, the attribute of animation data included 
15 in contents data 2FA is "010300". 

First, an example will be described, in which contents data IF and 2FA are input 
to contents data synthesizing apparatus 100 A. Here, contents synthesizing apparatus 
100 A determines whether contents data IF or contents data 2FA includes a synthesizing 
script or not. As the synthesizing script is included in contents data IF, next, attribute 
20 of animation data included in contents data 2FA is determined. The attribute of 

animation data included in contents data 2FA is "010200", and therefore, the animation 
data included in contents data IF is synthesized with contents data 2FA based on the 
script corresponding to the attribute "010200", and new contents data is stored. 

Next, an example will be described, in which contents data IF and 2FB are input 
25 to contents synthesizing apparatus 100 A. Here, contents synthesizing apparatus 100 A 
determines whether contents data IF or contents data 2FB includes a synthesizing script 
or not. As the synthesizing script is included in contents data IF, next, attribute of 
animation data included in contents data 2FB is determined. The attribute of animation 
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data included in contents data 2FB is "010300", the animation data included in contents 
data IF is synthesized with contents data 2FB based on the script corresponding to the 
attribute "010300", and new contents data is stored. 

The synthesizing script included scripts corresponding to attributes "010200" 
5 and "010300", respectively. The script corresponding to attribute "010300" describes 
that the to each key frame starting from key frame 1 of the animation data included in 
contents data including the synthesizing script, the object data included in each key 
frame of the animation data included in contents data 2FA including animation data 
having the attribute "010300" should be inserted. 
10 Further, the script corresponding to attribute "010200" describes that to each 

key frame starting from key frame 2 of the animation data included in contents data IF 
including the synthesizing script, the object data included in each key frame of the 
animation data included in contents data 2FB including animation data having the 
attribute "010200" should be inserted. 
15 As a result, when contents data IF and 2FA are input, contents synthesizing 

apparatus 100 provides key frame 1 of contents data IF as a new key frame 1. 

Next, the object data included in key frame 1 of contents data 2FA is inserted to 
key frame 2 of contents data IF, to provide a new key frame 2. 

Next, the object data included in key frame 2 of contents data 2FA is inserted to 
20 key frame 3 of contents data IF, to provide a new key frame 3. 

Finally, based on the new key frames 1 to 3, a header is generated, and contents 
data including the header and new key frames 1 to 3 is synthesized and stored. 

When contents data IF and 2FB are input, contents synthesizing apparatus 100 
inserts the object data included in key frame 1 of contents data 2FB into key frame 1 of 
25 contents data IF, to provide a new key frame 1. 

Next, the object data included in key frame 2 of contents data 2FB is inserted to 
key frame 2 of contents data IF, to provide a new key frame 2. 

Next, the object data included in key frame 3 of contents data 2FB is inserted to 
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key frame 3 of contents data 1F 5 to provide a new key frame 3. 

Finally, based on the new key frames 1 to 3, a header is generated, and contents 
data including the header and the new key frames 1 to 3 is synthesized and stored. 

Figs. 18 A, 18B, 18C, 18D, 18E, and 1 8F illustrate animation displayed when the 
5 contents data synthesized in accordance with the first example of synthesis of the second 
embodiment are reproduced. Figs. 18A to 18C show display images corresponding to 
respective key frames reproduced successively, when the contents data resulting from 
synthesis of contents data IF with contents data 2FA including animation data having 
the attribute "0 1 0200" is reproduced. 

10 Referring to Fig. 18 A, first, a circular figure is displayed at an upper portion of 

the image plane, slightly left from the center. Between Figs. 18A and 18B, the circular 
image moves downward. In Fig. 18B, the circular figure is displayed at a portion 
slightly lower than the center and slightly left from the center of the image plane, and a 
square figure is displayed slightly lower from the center of the image plane. Between 

15 Figs. 18B and 18C, the circular figure moves upward, and the square figure moves 
upward faster than the circular figure. In Fig. 18C, the circular figure is stopped 
slightly left from the center of the image, and the square figure stops slightly upper from 
the center of the image plane. 

Figs. 18D to 18F show display images corresponding to respective key frames 

20 reproduced successively, when the contents data resulting from synthesis of contents 
data IF with contents data 2FB including animation data having the attribute "010300" 
is reproduced. 

Referring to Fig. 18D, first, the circular figure is displayed at an upper portion of 
the image plane, slightly left from the center. Between Figs. 18D and 18E, the circular 
25 figure moves downward, and the square figure moves upward. In Fig. 1 8E, the 

circular figure is displayed slightly lower than the center and slightly left from the center 
of the image plane, and the square figure is displayed slightly upper than the center of 
the image plane. Between Figs. 18E and 18F, the circular figure moves upward, and 
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the square figure moves downward. In Fig. 18F, the circular figure is stopped slightly 
left from the center of the image plane, and the square figure is stopped at a lower 
center of the image plane. 

In this manner, based on the script corresponding to the determined attribute 
5 included in the synthesizing script included in contents data IF, the synthesizing process 
of synthesizing contents data IF with another contents data can be controlled. As a 
result, the synthesizing process can be controlled from the side of the contents data, and 
the synthesizing process appropriate for the attribute of contents data becomes possible. 

In the second embodiment, the attribute of contents data is described as attribute 
10 of animation data defined by the key frame included in the contents data. The attribute, 
however, is not limited thereto, and any index representing the feature of the contents 
data may be used. 

As described above, in the contents synthesizing apparatus 1 00 A in accordance 
with the second embodiment, input of the first contents data including the synthesizing 

15 script describing synthesis of contents data and input of the second contents data are 
received, attribute of the input second contents data is determined, and based on the 
script corresponding to the determined attribute included in the synthesizing script 
included in the input first contents data, the first contents data is synthesized with the 
second contents data. Therefore, the synthesizing process is controlled by the script 

20 corresponding to the attribute of the second contents data. As a result, the 

synthesizing process can be controlled from the side of the contents data, and the 
synthesizing process appropriate for the attribute of contents data becomes possible. 

Though the process performed by contents synthesizing apparatus 100 A has 
been described in the second embodiment, the present invention can also be 

25 implemented as a method of synthesizing contents executing the process shown in Figs. 
15 and 16 on a computer, a contents synthesizing program for causing a computer to 
execute the process shown in Figs. 15 and 16, a computer readable recording medium 
recording the contents synthesizing program, data structure of the contents data shown 
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in Fig. 17A, and a computer readable recording medium recording the contents data 
having the data structure. 
[Third Embodiment] 

In the third embodiment, an example will be described, in which the synthesizing 
5 script described with reference to the first embodiment includes a script dependent on 
time of synthesis by the contents synthesizing apparatus 100B. 

Fig. 19 schematically shows functions of the contents synthesizing apparatus 
100B in accordance with a third embodiment. Referring to Fig. 19, control portion 
1 10B of contents synthesizing apparatus 100B includes an input receiving portion 1 1 1, a 
10 synthesis processing portion 1 12B, and a time obtaining portion 114. Storage portion 
130 of contents synthesizing apparatus 100B stores a plurality of contents data. The 
contents data includes contents data including animation data and a synthesizing script, 
and contents data including animation data. Input receiving portion 1 1 1 has already 
been described with reference to Fig. 2 of the first embodiment, and therefore, 
15 description will not be repeated. 

When the synthesizing script included in contents data 10 includes a script that 
depends on the time of synthesis of the contents data, synthesis processing portion 1 12B 
instructs time obtaining portion 1 14 to obtain time. 

In response to the instruction from synthesis processing portion 1 12B, time 
20 obtaining portion 1 14 obtains current time, and sends the time to synthesis processing 
portion 1 12B. The current time may be obtained, by way of example, by a timer 
function of contents synthesizing apparatus 100B, or by other method. 

Synthesis processing portion 112B synthesizes contents data 10 input through 
input receiving portion 1 1 1 with contents data 20 input through input receiving portion 
25 111, based on the script corresponding to the time obtained by time obtaining portion 
1 14, of the synthesizing script included in contents data 10. Synthesis processing 
portion 1 12B has synthesized contents data 30 stored in storage portion 130. 
Synthesis processing portion 112B may directly send the synthesized contents data 30 to 
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other PC or the like through network 500 using communication portion 160, or store 
the same on recording medium 171 using external storage apparatus 170. 

Fig. 20 is a flowchart representing a flow of a data synthesizing process executed 
by the contents synthesizing apparatus 100B in accordance with the third embodiment. 
5 The data synthesizing process is the process executed in step S13 of contents 

synthesizing process described with reference to Fig. 3. Referring to Fig. 20, first, in 
step S41, whether the synthesizing script includes a time-dependent script or not is 
determined. When the synthesizing script includes a time-dependent script (Yes in step 
S41), in step S42, time obtaining portion 1 14 obtains current time, and in step S43, 
10 synthesis processing portion 1 12B executes a synthesizing process of synthesizing 

contents data 10 input in step SI 1 with contents data 20 input in step SI 1, based on the 
script corresponding to the current time obtained in step S42, and then the flow returns 
to the contents synthesizing process. 

If the synthesizing script does not include any time-dependent script (No in step 
15 S41), the flow returns to the contents synthesizing process. 

(First Example of Synthesis in Accordance with the Third Embodiment) 

Figs. 21 A and 2 IB show data structures of the contents data before synthesis, in 
the first example of synthesis in accordance with the third embodiment. Fig. 21 A 
shows data structure of contents data II including the synthesizing script. Referring to 
20 Fig. 21 A, contents data II includes a header, key frames 1 to 3 and a synthesizing script. 

Key frames 1 to 3 are the same as key frames 1 to 3 of contents data IF 
described with reference to Fig. 17A, and therefore, description will not be repeated. 

The synthesizing script included in contents data II includes a synthesizing script 
corresponding to time "morning" and a synthesizing script corresponding to time 
25 "afternoon". The synthesizing script corresponding to time "morning" includes, as 
control contents, "insertion of an object from another file", and as a parameter, "key 
frame 1~". Further, the synthesizing script corresponding to time "afternoon" includes, 
as control contents, "insertion of an object from another file", and as a parameter, "key 



-39- 



frame 2~" Control contents "insertion of an object from another file" and parameters 
"key frame 1~" and "key frame 2~" have already been described with reference to Fig. 
4A, and therefore, description thereof will not be repeated. 

Fig. 2 IB shows data structure of contents data 21. Contents data 21 shown in 
5 Fig. 2 IB is the same as contents data 2A described with reference to Fig. 4B, and 
therefore, description thereof will not be repeated. 

First, an example will be described, in which synthesis of contents data II and 
contents data 21 by contents synthesizing apparatus 100B takes place in the morning. 
Here, contents synthesizing apparatus 100B receives input of contents data II and 21. 
10 As the synthesizing script is included in contents data II and the time of synthesis is in 
the morning, object data included in each key frame of contents data 21 is inserted to 
each key frame starting from key frame 1 of contents data II, based on the script 
corresponding to the morning, and a new contents data is stored. 

Next, an example will be described, in which synthesis of contents data II and 
15 contents data 21 by contents synthesizing apparatus 100B takes place in the afternoon. 
Here, contents synthesizing apparatus 100B receives input of contents data II and 21. 
As the synthesizing script is included in contents data II and the time of synthesis is in 
the afternoon, object data included in each key frame of contents data 21 is inserted to 
each key frame starting from key frame 2 of contents data II, based on the script 
20 corresponding to the afternoon, and a new contents data is stored. 

The synthesizing script includes scripts corresponding to the morning and the 
afternoon. The script corresponding to the morning describes that to each key frame 
from key frame 1 of contents data II including the synthesizing script, the object data 
included in each key frame of contents data 21 should be inserted. The script 
25 corresponding to the afternoon describes that to each key frame from key frame 2 of 
contents data II including the synthesizing script, the object data included in each key 
frame of contents data 21 should be inserted. 

Therefore, when the time of synthesis is in the morning, contents synthesizing 
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apparatus 100B inserts the object data included in key frame 1 of contents data 21 into 
key frame 1 of contents data II, to provide a new key frame 1. 

Thereafter, the object data included in key frame 2 of contents data 21 is inserted 
to key frame 2 of contents data II, to provided key frame 2 of the new contents data. 

Thereafter, key frame 3 of contents data II is provided as key frame 3 of the new 
contents data. 

Finally, based on the new key frames 1 to 3, a header is generated, and the 
contents data including the header and the new key frames 1 to 3 is synthesized and 
stored. 

When the time of synthesis is in the afternoon, contents synthesizing apparatus 
100B provides key frame 1 of contents data II as a new key frame 1. 

Next, the object data included in key frame 1 of contents data 21 is inserted to 
key frame 2 of contents data II, to provide a new key frame 2. 

Thereafter, the object data included in key frame 2 of contents data 21 is inserted 
to key frame 3 of contents data II, to provide key frame 3 of the new contents data. 

Finally, based on the new key frames 1 to 3, a header is generated, and the 
contents data including the header and the new key frames 1 to 3 is synthesized and 
stored. 

Figs. 22A, 22B, 22C, 22D, 22E, and 22F illustrate animation displayed when the 
contents data synthesized in accordance with the first example of synthesis of the third 
embodiment are reproduced. Figs. 22A to 22C represent display images corresponding 
to respective key frames reproduced successively, when the contents data resulting from 
synthesis of contents data II and 21 in the morning are reproduced. Figs. 22 A to 22C 
are the same as Figs. 18D to 18F, respectively, and therefore, description thereof will 
not be repeated. 

Figs. 22D to 22F represent display images corresponding to respective key 
frames reproduced successively, when the contents data resulting from synthesis of 
contents data II and 21 in the afternoon are reproduced. Figs. 22D to 22F are the 
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same as Figs. 18A to 18F, respectively, and therefore, description thereof will not be 
repeated. 

In this manner, the synthesizing process is controlled by the script corresponding 
to the time of synthesis included in contents data II. As a result, the synthesizing 
5 process can be controlled from the side of the contents data II, and the synthesizing 
process appropriate for the time of synthesizing the contents data becomes possible. 

As described above, in the contents synthesizing apparatus 100B in accordance 
with the third embodiment, input of the first contents data including the synthesizing 
script describing synthesis of contents data and input of the second contents data are 
10 received, current time is obtained, and based on the script corresponding to the current 
time included in the synthesizing script included in the input first contents data, the first 
contents data is synthesized with the second contents data. Therefore, the synthesizing 
process is controlled by the script corresponding to the time of synthesis. As a result, 
the synthesizing process can be controlled from the side of the contents data and the 
15 synthesizing process appropriate for the time of synthesizing the contents data becomes 
possible. 

Though the process performed by contents synthesizing apparatus 100B has 
been described in the third embodiment, the present invention can also be implemented 
as a method of synthesizing contents executing the process shown in Fig. 20 on a 

20 computer, a contents synthesizing program for causing a computer to execute the 

process shown in Fig. 20, a computer readable recording medium recording the contents 
synthesizing program, data structure of the contents data shown in Fig. 21 A, and a 
computer readable recording medium recording the contents data having the data 
structure. 

25 [Fourth Embodiment] 

In the fourth embodiment, an example will be described, in which the 
synthesizing script described with respect to the first embodiment includes a script 
corresponding to a position of synthesis by a contents synthesizing apparatus 100C. 



-42- 



Fig. 23 schematically shows functions of the contents synthesizing apparatus 
100C in accordance with a fourth embodiment. Referring to Fig. 23, a control portion 
1 IOC of contents synthesizing apparatus 100C includes an input receiving portion 1 1 1, a 
synthesis processing portion 1 12C, and a position obtaining portion 115. Storage 
portion 130 of contents synthesizing apparatus 100C stores a plurality of contents data. 
The contents data includes contents data including animation data and a synthesizing 
script, and contents data including animation data. Input receiving portion 111 has 
already been described with reference to Fig. 2 of the first embodiment, and therefore, 
description thereof will not be repeated. 

When the synthesizing script included in contents data 10 input through input 
receiving portion 1 1 1 includes a script corresponding to a position of synthesis of the 
contents data, synthesis processing portion 1 12C instructs position obtaining portion 
1 1 5 to obtain a position. 

In response to the instruction from synthesis processing portion 1 12C, position 
obtaining portion 1 1 5 obtains the current position of content synthesizing apparatus 
100C, and sends the position to synthesis processing portion 1 12C. The current 
position may be obtained, for example, by a GPS (Global Positioning System) or it may 
be obtained by other method. 

Synthesis processing portion 1 12C synthesizes contents data 10 input through 
input receiving portion 1 1 1 with contents data 20 input through input receiving portion 
111, based on the script corresponding to the position obtained by position obtaining 
portion 1 15, of the synthesizing script included in contents data 10. Synthesis 
processing portion 1 12C has synthesized contents data 30 stored in storage portion 130. 
Synthesis processing portion 1 12C may directly transmit the synthesized contents data 
30 to other PC or the like through network 500 using communication portion 160, or 
store the same on recording medium 171 using external storage apparatus 170. 

Fig. 24 is a flowchart representing a flow of a data synthesizing process executed 
by the contents synthesizing apparatus 100C in accordance with the fourth embodiment. 
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The data synthesizing process is the process executed in step S13 of contents 
synthesizing process described with reference to Fig. 3. Referring to Fig. 24, first, in 
step S51, whether the synthesizing script includes a position-dependent script or not is 
determined. When the synthesizing script includes a position-dependent script (Yes in 
5 step S51), position obtaining portion 115 obtains the current position in step S52, and in 
step S53, synthesis processing portion 112C executes a synthesizing process of 
synthesizing contents data 10 input in step SI 1 with contents data 20 input in step SI 1, 
based on the script dependent on the current position obtained in step S53, and then the 
flow returns to the contents synthesizing process. 
10 If the synthesizing script does not include any position-dependent script (No in 

step S51), the flow returns to the contents synthesizing process. 

(First Example of Synthesis in Accordance with the Fourth Embodiment) 
Figs. 25 A and 25B show data structures of the contents data before synthesis, in 
the first example of synthesis in accordance with the fourth embodiment. Referring to 
15 Fig. 25 A, contents data 1 J including the synthesizing script includes a header, key 
frames 1 to 3 and the synthesizing script. 

Key frames 1 to 3 are the same as key frames 1 to 3 of contents data IF 
described with reference to Fig. 17 A, and therefore, description thereof will not be 
repeated. 

20 The synthesizing script included in contents data 1 J includes a synthesizing script 

corresponding to the position "Osaka" and includes a synthesizing script corresponding 
to the position "Nara". The synthesizing script corresponding to the position "Osaka" 
includes, as control contents, "insertion of an object from another file", and as a 
parameter, "key frame 1~". The synthesizing script corresponding to the position 

25 "Nara" includes, as control contents, "insertion of an object from another file", and as a 
parameter, "key frame 2~" Control contents "insertion of an object from another file" 
and parameters "key frame 1~" and "key frame 2-" have already been described with 
reference to Fig. 4A, and therefore, description thereof will not be repeated. 



-44- 



Fig. 25B shows data structure of contents data 2J. Contents data 2J shown in 
Fig. 25B is the same as contents data 2A described with reference to Fig. 4B, and 
therefore, description thereof will not be repeated. 

First, an example will be described, in which the position of synthesis of contents 
5 data 1J and 2 J by contents data synthesizing apparatus 100C is Osaka. Here, contents 
synthesizing apparatus 100C receives input of contents data 1J and 2 J. As the 
synthesizing script is included in contents data 1J and the position of synthesis is Osaka, 
object data included in each key frame of contents data 2J is inserted to each key frame 
from key frame 1 of contents data 1J, based on the script corresponding to Osaka, and a 

10 new contents data is stored. Display images corresponding to respective key frames 
reproduced successively, when the animation data resulting from synthesis of contents 
data 1J and 2J in Osaka is reproduced, are the same as Figs. 18D to 18F, and therefore, 
description thereof will not be repeated. 

Next, an example will be described, in which the position of synthesis of contents 

15 data 1 J and 2 J by contents data synthesizing apparatus 100C is Nara. Here, contents 
synthesizing apparatus 100C receives input of contents data 1J and 2 J. As the 
synthesizing script is included in contents data 1 J and the position of synthesis is Nara, 
object data included in each key frame of contents data 2 J is inserted to each key frame 
from key frame 2 of contents data 1 J, based on the script corresponding to Nara, and a 

20 new contents data is stored. Display images corresponding to respective key frames 
reproduced successively, when- the animation data resulting from synthesis of contents 
data 1J and 2J in Nara is reproduced, are the same as Figs. 18A to 18C, and therefore, 
description thereof will not be repeated. 

The synthesizing script includes scripts corresponding Osaka and Nara. The 

25 script corresponding to Osaka describes that to each key frame from key frame 1 of 
contents data 1 J including the synthesizing script, the object data included in each key 
frame of contents data 2 J should be inserted. The script corresponding to Nara 
describes that to each key frame from key frame 2 of contents data 1J including the 
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synthesizing script, the object data included in each key frame of contents data 2 J should 
be inserted. 

Therefore, when the position of synthesis is Osaka, contents synthesizing 
apparatus 100C inserts the object data included in key frame 1 of contents data 23 into 
5 key frame 1 of contents data 1 J, to provide a new key frame 1 . 

Thereafter, the object data included in key frame 2 of contents data 2 J is inserted 
to key frame 2 of contents data 1 J, to provided a new key frame 2. 

Thereafter, key frame 3 of contents data 1J is provided as a new key frame 3. 
Finally, based on the new key frames 1 to 3, a header is generated, and the 
10 contents data including the header and the new key frames 1 to 3 is synthesized and 
stored. 

When the position of synthesis is Nara, contents synthesizing apparatus 100C 
provides key frame 1 of contents data 1J as a new key frame 1. 

Next, the object data included in key frame 1 of contents data 2J is inserted to 
15 key frame 2 of contents data 1 J, to provide a new key frame 2. 

Thereafter, the object data included in key frame 2 of contents data 2 J is inserted 
to key frame 3 of contents data 1 J, to provide a new key frame 3. 

Finally, based on the new key frames 1 to 3, a header is generated, and the 
contents data including the header and the new key frames 1 to 3 is synthesized and 
20 stored. 

The display images corresponding to respective key frames reproduced 
successively, when the contents data resulting from synthesis of contents data 1 J and 2 J 
in Osaka are reproduced are the images shown in Figs. 18D to 18F. The display 
images corresponding to respective key frames reproduced successively, when the 
25 contents data resulting from synthesis of contents data 1 J and 2 J in Nara are reproduced 
are the images shown in Figs. 18A to 18C. 

As described above, in the contents synthesizing apparatus 100C in accordance 
with the fourth embodiment, input of the first contents data including the synthesizing 
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script describing synthesis of contents data and input of the second contents data are 
received, current position of contents synthesizing apparatus 1 00C is obtained, and 
based on the script corresponding to the obtained current position included in the 
synthesizing script included in the input first contents data, the first contents data is 
synthesized with the second contents data. Therefore, the synthesizing process is 
controlled by the script corresponding to the place of synthesis. As a result, the 
synthesizing process can be controlled from the side of the contents data and the 
synthesizing process appropriate for the place of synthesizing the contents data becomes 
possible. 

Though the process performed by contents synthesizing apparatus 100C has 
been described in the fourth embodiment, the present invention can also be implemented 
as a method of synthesizing contents executing the process shown in Fig. 24 on a 
computer, a contents synthesizing program for causing a computer to execute the 
process shown in Fig. 24, a computer readable recording medium recording the contents 
synthesizing program, data structure of the contents data shown in Fig. 25A, and a 
computer readable recording medium recording the contents data having the data 
structure. 

[Fifth Embodiment] 

In the fifth embodiment, an example of synthesis will be described in which 
animation data is encrypted and an example of synthesis in which encrypted animation 
data is decoded, based on synthesizing scripts included in the contents data. 

The function of the contents synthesizing apparatus in accordance with the fifth 
embodiment is the same as those of contents synthesizing apparatus 100 described with 
reference to the second embodiment, and therefore, description thereof will not be 
repeated. 

Fig. 26 is a flowchart representing a flow of a data synthesizing process executed 
by the contents synthesizing apparatus in accordance with the fifth embodiment. The 
data synthesizing process is the process executed in step S23 of the data synthesizing 
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process described with reference to Fig. 15. Referring to Fig. 15, first, in step S51, by 
the synthesis processing portion, the synthesizing process is performed based on the 
synthesizing script. In step S52, the synthesis processing portion determines whether 
or not the synthesizing script includes any script indicating that a new synthesizing script 
should be included. If the synthesizing script includes a script indicating that a new 
synthesizing script should be included (Yes in step S52), in step S53, the synthesis 
processing portion adds the new synthesizing script included in the synthesizing script to 
the contents data synthesized in step S51, and the flow returns to the data synthesizing 
process described with reference to Fig. 15. 

If the synthesizing script does not include any script indicating that a new 
synthesizing script should be included (No in step S52), the flow returns to the data 
synthesizing process described with reference to Fig. 15. 

(First Example of Synthesis in Accordance with the Fifth Embodiment) 

Here, an example of synthesis will be described, in which animation data is 
encrypted based on the synthesizing script included in contents data. 

Figs. 27 A and 27B show data structures of the contents data before synthesis, in 
the first example of synthesis in accordance with the fifth embodiment. Fig. 27A 
represents data structure of contents data ID including a synthesizing script. Referring 
to Fig. 27 A, contents data ID includes a header, a key frame 1 and the synthesizing 
script. 

Key frame 1 includes a control data "repeat" that indicates repeated 
reproduction of key frames up to this key frame. 

The synthesizing script of contents data ID includes, as the first control contents, 
"addition of key frame", and as the first parameter, "after key frame 1". Further, it 
includes, as the second control contents, "addition of synthesizing script", and as the 
second parameter, another synthesizing script. 

The first control contents, "addition of key frame" has already been described 
with reference to Fig. 10, and therefore, description thereof will not be repeated. The 
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first parameter "after key frame 1" indicates that the target position of the synthesizing 
process represented by the control contents is after the key frame of animation data 
included in contents data ID including the synthesizing script. 

The second control contents, "addition of synthesizing script" indicates that the 
5 target data designated by the parameter should be added to the contents data ID. The 
said another script as the second parameter represents the target data of the synthesizing 
process represented by the control contents. 

The said another synthesizing script as the second parameter includes a 
synthesizing script corresponding to attribute "000000". The synthesizing script 
10 corresponding to attribute "000000" includes, as the control contents, "deletion of key 
frame", and as a parameter, "key frame 1". The control contents "deletion of key 
frame" indicates that the target key frame designated by the parameter should be deleted. 
The parameter "key frame 1" indicates that the target key frame of the synthesizing 
process represented by the control contents is key frame 1 of the animation data 
15 included in the contents data including the synthesizing script. 

Fig. 27B shows data structure of contents data 2D. Referring to Fig. 27B, 
contents data 2D includes a header and key frames 1 to 3. 

Key frames 1 to 3 are the same as key frames 2 to 4 of contents data IB 
described with reference to Fig. 7 A, and therefore, description thereof will not be 
20 repeated. 

The contents synthesizing apparatus receives input of contents data ID and 2D, 
and whether contents data ID or 2D includes the synthesizing script or not is 
determined. As contents data ID includes the synthesizing script, contents data ID is 
synthesized with animation data 2D based on the synthesizing script, and a contents data 
25 3D, which will be described later, is stored. 

The synthesizing script describes that the key frame included in contents data 2D 
should be added after key frame 1 of contents data ID including the synthesizing script, 
and another synthesizing script should be included in the synthesized contents data. 
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Therefore, the contents synthesizing apparatus provides key frame 1 of contents 
data ID including the control data "repeat" as a new key frame 1. 

Next, key frames 1 to 3 included in contents data 2D are added after key frame 1 
of contents data ID, to provide new key frames 2 to 4. 
5 Finally, based on the new key frames 1 to 4, a header is generated, and contents 

data 3D including the header, new key frames 1 to 4, and the new synthesizing script 
included in the synthesizing script of contents data ID is synthesized and stored. 

Fig. 28 shows data structure of the contents data 3D after synthesis, in the first 
example of synthesis in accordance with the fifth embodiment. Referring to Fig. 28, 
10 contents data 3D resulting from synthesis of contents data ID and 2D by the contents 
synthesizing apparatus includes a header, key frames 1 to 4 and a synthesizing script. 

Key frame 1 is the same as key frame 1 of contents data ID described with 
reference to Fig. 27A. 

Key frames 2 to 4 are the same as key frames 1 to 3 of contents data 2D 
15 described with reference to Fig. 27B. 

The synthesizing script is the said another synthesizing script included in the 
synthesizing script of contents data ID described with reference to Fig. 27A. 

In this manner, the synthesizing process of adding the key frame included in 
contents data 2D to a prescribed portion of contents data ID is controlled by the 
20 synthesizing script included in contents data ID. As a result, the synthesizing process 
of adding other contents data 2D can be controlled from the side of contents data ID. 

As described above, by the synthesizing process represented by the first example 
of synthesis in accordance with the fifth embodiment, contents data ID including the 
synthesizing script described with reference to Fig. 27A and contents data 2D described 
25 with reference to Fig. 27B are synthesized by the contents synthesizing apparatus, and 
contents data 3D described with reference to Fig. 28 is synthesized. Further, when 
contents data 2D is reproduced by a reproducing apparatus, an animation that a circular 
figure moves is reproduced. On the other hand, when contents data 3D is reproduced 
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by a reproducing apparatus, though it includes a key frame to display an animation that 
the circular figure moves, the animation that the circular figure moves is not reproduced, 
as the control data "repeat" is included in key frame 1 . In this manner, reproduction of 
contents data 2D can be prevented by the synthesis with contents data ID. This state 
5 is referred to as an encrypted state of contents data 2D. Here, contents data ID is a so 
called encryption key for encrypting contents data 2D. 

Specifically, by using, as an encryption key, contents data including a key frame 
including the control data "repeat" and a synthesizing script describing that a new 
synthesizing script should be included in the synthesized contents data, the new script 
10 describing that a key frame included in another contents data should be added after the 
key frame including the control data "repeat" and that the key frame including the 
control data "repeat" corresponding to a prescribed attribute should be deleted, the said 
another contents data can be encrypted. 

Further, the synthesizing script included in contents data 1G controls the 
15 synthesizing process of deleting a prescribed portion included in contents data 1G. As 
a result, the synthesizing process of deleting a prescribed portion of contents data 1G 
can be controlled from the side of contents data 1G. 

(Second Example of Synthesis in Accordance with the Fifth Embodiment) 

Here, a first example of synthesis will be described, in which encrypted animation 
20 data is decoded by the contents synthesizing apparatus. 

Figs. 29A and 29B show data structures of the contents data before synthesis, in 
the second example of synthesis in accordance with the fifth embodiment. Fig. 29A 
shows the data structure of contents data 1G including a synthesizing script. Contents 
data 1G is the same as contents data 3D obtained by synthesis of contents data 2D with 
25 contents data ID, described with reference to Fig. 28, and therefore, description will not 
be repeated. 

Fig. 29B shows a data structure of contents data 2G. Referring to Fig. 29B, 
contents data 2G includes a header only. Specifically, the animation data included in 
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contents data 2G has the attribute "000000". 

The contents synthesizing apparatus receives inputs of contents data 1G and 2G, 
and whether contents data 1G or 2G includes a synthesizing script or not is determined. 
As contents data 1G includes a synthesizing script, next, attribute of the animation data 
5 included in contents data 2G is determined. The attribute of animation data included in 
contents data 2G is "000000", and therefore, based on the script corresponding to the 
attribute "000000", contents data 1G is synthesized with contents data 2G, and contents 
data 3G, which will be described later, is stored. 

The synthesizing script includes the script corresponding to the attribute 
10 "000000". The script corresponding to the attribute "000000" describes that, when the 
animation data included in the other contents data 2G to be synthesized with contents 
data 1G including the synthesizing script is "000000", key frame 1 of contents data 1G 
should be deleted. 

Therefore, when contents data 1G and 2G are input, the contents synthesizing 
15 apparatus deletes key frame 1 of contents data 1G. 

Next, key frames 2 to 4 of contents data 1G are provided as new key frames 1 to 

3. 

Finally, based on new key frames 1 to 3, a header is generated, and contents data 
3G including the header and new key frames 1 to 3 is synthesized and stored. 

20 Fig. 30 shows data structure of the contents data 3G after synthesis, in the 

second example of synthesis in accordance with the fifth embodiment. Contents data 
3G obtained by the synthesis of contents data 1G and 2G by contents synthesizing 
apparatus 100 A shown in Fig. 30 is the same as contents data 2D described with 
reference to Fig. 27, and therefore, description thereof will not be repeated. 

25 As described above, by the synthesizing process represented by the second 

example of synthesis in accordance with the fifth embodiment, contents data 1G same as 
the contents data 3D described with reference to Fig. 28 and including the synthesizing 
script described with reference to Fig. 29A is synthesized by the contents synthesizing 
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apparatus with contents data 2G described with reference to Fig. 29B, whereby contents 
data 3G described with reference to Fig. 30 is synthesized. Contents data 3G is the 
same as contents data 2D described with reference to Fig. 27B. In this manner, when 
the contents data 1 G having contents data 2D in an encrypted state is synthesized with 
5 contents data 2G, contents data 2D can be set to a reproducible state. This state is 

referred to the so-called decoded state of contents data 2D. Here, contents data 2G is 
a decoding key for decoding contents data 2D. 

Specifically, by using a contents data of a prescribed attribute as a decoding key, 
another contents data can be decoded. 
10 (Third Example of Synthesis in Accordance with the Fifth Embodiment) 

Here, a second example of synthesis will be described, in which encrypted 
animation data is decoded by the contents synthesizing apparatus. 

Figs. 3 1 A and 3 IB show data structures of the contents data before synthesis, in 
the third example of synthesis in accordance with the fifth embodiment. Referring to 
15 Fig. 31, contents data 1H has the synthesizing script included in contents data 3D 

described with reference to Fig. 28 changed. Specifically, it results from synthesis with 
contents data 2D, with another synthesizing script included in the synthesizing script of 
contents data ID described with reference to Fig. 27 changed. 

The synthesizing script included in contents data 1H includes a script 
20 corresponding to attribute "000000". The synthesizing script corresponding to the 
attribute "000000" includes, as control contents, "change of data" and as a parameter, 
"key frame 1 Gump to 2)". The control contents "change of data" indicates that the 
data at the target position designated by the parameter should be changed to the target 
data designated by the parameter. The parameter "key frame 1 Q um P to 2)" indicates 
25 that the target position of the synthesizing process represented by the control contents is 
key frame 1 of animation data included in the contents data including the synthesizing 
script, and the target data of the synthesizing process represented by the control 
contents is the control data "jump to 2". 
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Fig. 3 IB represents data structure of contents data 2H. Contents data 2H 
shown in Fig. 3 IB is the same as contents data 2G described with reference to Fig. 29B, 
and therefore, description thereof will not be repeated. 

The contents synthesizing apparatus receives inputs of contents data 1H and 2H, 
5 and whether contents data 1H or 2H includes a synthesizing script or not is determined. 
As contents data 1H includes a synthesizing script, next, attribute of the animation data 
included in contents data 2H is determined. The attribute of animation data included in 
contents data 2H is "000000", and therefore, based on the script corresponding to the 
attribute "000000", contents data 1H is synthesized with contents data 2H, and contents 
10 data 3H, which will be described later, is stored. 

The synthesizing script includes the script corresponding to the attribute 
"000000". The script corresponding to the attribute "000000" describes that, when the 
animation data included in the other contents data 2H to be synthesized with contents 
data 1H including the synthesizing script is "000000", the control data included in key 
15 frame 1 of the animation data of contents data 1H should be changed to control data 
"jump to 2". 

Therefore, when contents data 1H and 2H are input, the contents synthesizing 
apparatus changes the control data "repeat" included in key frame 1 of contents data 1H 
to control data "jump to 2", to provide a new key frame 1. 
20 Thereafter, key frames 2 to 4 of contents data 1H are provided as new key 

frames 2 to 4. 

Finally, based on new key frames 1 to 4, a header is generated, and contents data 
3H including the header and new key frames 1 to 4 is synthesized and stored. 

Fig. 32 shows data structure of the contents data 3H after synthesis, in the third 
25 example of synthesis in accordance with the fifth embodiment. Referring to Fig. 32, 
contents data 3H resulting from synthesis of contents data 1H and 2H by the contents 
synthesizing apparatus includes a header and key frames 1 to 4. 

Key frame 1 corresponds to key frame 1 of contents data 1H with the control 
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data changed to "jump to 2" 

Key frames 2 to 4 are the same as key frames 1 to 3 of contents data ID 
described with reference to Fig. 27, and therefore, description thereof will not be 
repeated. 

5 As described above, by the synthesizing process shown as a third example of 

synthesis in accordance with the fifth embodiment, contents data 1H including the 
synthesizing script described with reference to Fig. 3 1 A having the synthesizing script of 
contents data 3D described with reference to Fig. 28 changed, and the contents data 2H 
described with reference to Fig. 3 IB are synthesized by the contents synthesizing 

10 apparatus, whereby contents data 3H described with reference to Fig. 32 is synthesized. 
The animation provided when the contents data 3G is reproduced by the reproducing 
apparatus is the same as that when contents data 2D described with reference to Fig. 
27B is reproduced by the synthesizing apparatus. In this manner, when contents data 
1H that corresponds to contents data 2D in the encrypted state is synthesized with 

15 contents data 2H, contents data 2D can be decoded. 

Specifically, by using, as an encryption key, contents data including a key frame 
including the control data "repeat" and a synthesizing script describing that a new 
synthesizing script should be included in the synthesized contents data, the new script 
describing that a key frame included in the other contents data should be added after the 

20 key frame including the control data "repeat" and that the key frame including the 
control data "repeat" corresponding to a prescribed attribute should be changed to 
control data "jump to 2", the other contents data can be encrypted. Further, by using a 
contents data including animation data of a prescribed attribute as a decoding key, 
another contents data can be decoded. 

25 Though the process performed by contents synthesizing apparatus has been 

described in the fifth embodiment, the present invention can also be implemented as a 
method of synthesizing contents executing the process shown in Fig. 26 on a computer, 
a contents synthesizing program for causing a computer to execute the process shown in 
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Fig. 26, a computer readable recording medium recording the contents synthesizing 
program, data structure of the contents data shown in Figs. 27 A, 29 A and 3 1 A, and a 
computer readable recording medium recording the contents data having the data 
structure. 
5 [Sixth Embodiment] 

In the sixth embodiment, an example will be described, in which location 
information indicating location of the synthesizing script described with reference to the 
first embodiment is included in contents data 10. 

Fig. 33 schematically shows functions of the contents synthesizing apparatus 
10 100D in accordance with a sixth embodiment. Referring to Fig. 33, control portion 
1 10D of contents synthesizing apparatus 100D includes input receiving portion 1 1 1, a 
synthesis processing portion 1 12D, and a synthesizing script obtaining portion 116, 
Storage portion 130 of contents synthesizing apparatus 100D stores a plurality of 
contents data. The contents data includes contents data including animation data and a 
15 synthesizing script, and contents data including animation data. Input receiving portion 
111 has already been described with reference to Fig. 2 of the first embodiment, and 
therefore, description will not be repeated. 

When contents data input through input receiving portion 1 1 1 includes location 
information indicating location of the synthesizing script, synthesis processing portion 
20 1 12D instructs synthesizing script obtaining portion 1 16 to obtain the synthesizing script. 
In response to the instruction from synthesis processing portion 1 12D, 
synthesizing script obtaining portion 1 16 obtains a synthesizing script 40 and sends the 
same to synthesis processing portion 1 12D. In this example, synthesizing script 40 is 
stored in storage portion 130. The location indicated by location information of 
25 synthesizing script is not limited to a location indicated by the address in storage portion 
130 of contents synthesizing apparatus 100D, and it may be a location indicated by a 
URL (Uniform Resource Locator), or a location indicated by a path of the synthesizing 
script included in recording medium 171. 
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Based on the synthesizing script obtained by synthesizing script obtaining portion 
1 16, synthesis processing portion 1 12D synthesizes contents data 10 input through input 
receiving portion 1 1 1 with contents data 20 input through input receiving portion 111. 
Synthesis processing portion 1 12D has synthesized contents data 30 stored in storage 
5 portion 130. Synthesis processing portion 1 12D may directly transmit the synthesized 
contents data 30 to other PC or the like through network 500 using communication 
portion 160, or store the same on recording medium 171 using external storage 
apparatus 170. 

When the synthesizing script of contents data ID described with reference to Fig. 

10 27 includes location information of the synthesizing script to be included in newly 

synthesized contents data, synthesis processing portion 1 12D may have the synthesizing 
script obtained by synthesizing script obtaining portion 1 16 included in the newly 
synthesized contents data, based on the location information. 

Fig. 34 is a flowchart representing a flow of a data synthesizing process executed 

15 by the contents synthesizing apparatus 100D in accordance with the sixth embodiment. 
The data synthesizing process is executed in step S13 of the contents synthesizing 
process described with reference to Fig. 3. Referring to Fig. 34, first, in step S61, 
synthesis processing portion 1 12D interprets the synthesizing script included in contents 
data 10 input in step SI 1, and in step S62, whether contents data 10 includes location 

20 information of synthesizing script or not is determined. If contents data 10 includes the 
location information of synthesizing script (Yes in step S62), in step S63, synthesizing 
script obtaining portion 1 16 obtains the synthesizing script indicated by the location 
information of synthesizing script, and in step S64, based on the synthesizing script 
obtained in step S63, synthesis processing portion 1 12D performs the synthesizing 

25 process of synthesizing contents data 10 input in step SI 1 with contents data 20 input in 
step SI 1, and the flow returns to the contents synthesizing process. 

If contents data 10 does not include the location information of synthesizing 
script (No in step S62), the flow returns to the contents synthesizing process. 



-57- 



As described above, in contents synthesizing apparatus 100D in accordance with 
the sixth embodiment, input of the first contents data including the location information 
indicating location of the synthesizing script describing synthesis of contents data and 
input of the second contents data are received, the synthesizing script indicated by the 
location information included in the input first contents data is obtained, and based on 
the obtained synthesizing script, the input first contents data is synthesized with the 
input second contents data. Therefore, the synthesizing process is controlled by the 
synthesizing script indicated by the location information included in the first contents 
data. Further, as the location information of synthesizing script is included in the first 
contents data, it is unnecessary to newly prepare the synthesizing script when the first 
and second contents data are synthesized. As a result, the synthesizing process can be 
controlled from the side of the contents data and the necessity of newly preparing the 
synthesizing script required for synthesizing contents data can be eliminated. 

Further, in contents synthesizing apparatus 100D in accordance with the sixth 
embodiment, another synthesizing script indicated by the location information included 
in the synthesizing script indicating location of the said another synthesizing script is 
obtained, and the obtained another synthesizing script is included in the synthesized 
contents data. As a result, the synthesizing process can be controlled from the side of 
the newly synthesized contents data. 

Though the process performed by contents synthesizing apparatus 100D has 
been described in the sixth embodiment, the present invention can also be implemented 
as a method of synthesizing contents executing the process shown in Fig. 34 on a 
computer, a contents synthesizing program for causing a computer to execute the 
process shown in Fig. 34, and a computer readable recording medium recording the 
contents synthesizing program. 

Although the present invention has been described and illustrated in detail, it is 
clearly understood that the same is by way of illustration and example only and is not to 
be taken by way of limitation, the spirit and scope of the present invention being limited 
only by the terms of the appended claims. 
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